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(57) Abstract 

I In a meflwd and a de- 
vice for partial encryptioo and 
oiogrcssive transmission of im- 
ages, a first section of the im- 
aic file is compressed at reduced 

Quality witiiout decrypuon. and 
r^nd section of the unage 
file is encrypted. Usmhavmg 
access to appropnate dccrypUon 
teywocds can decrypt this sec- 
ond sectioa. 

togpthcr with the dcoypto^w^ 
ond section can then wvieww 
as a ftill quality image, •nwstw; 
age space requittd for stonng the 

fiBt ind section ««>gelh" « ^ 
sentialW the same as Ae stor- 
I age space itquired for sto"n8 
' tte unencrypted full qua^i5[«nv. 

age. By using the roe&od and 
1 ^vice as described herein stor- 
age and bandwidth requirements 
for partially encrypted ima^ « 
' reduced. Furtheimorc. object 
based composition and process- 
' ing of encrypted objects are fti- 
1 dlitated. and ROIs can be «- 
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A METHOD AND A DEVICE FOR ENCRYPTION OF IMAGES 

^Z::Z^^^o. «Xa.e. .o a ana a aev.ce .o. 

encrypting images. 

H^OROOSB O. THE ™iO» »»= ^^.^ field whic. beccne. 
Hncryption of digital data xs^a or 
ijroortaiit when transmitting and storing secret 
t^^or^ation whiC only shall be available to a J^^^^^f 

infor^tion. «ms. several methods for 
aata are in frequent use. Such methods can also he 
to digital image data. Exa-^les of encrvption methods are DES, 
triple DES and the public-key RSA i»ethod. 

-rtirrt^rfs "digrtriLgtdTtrr::! r also 

service '"^^"^^^Vn XT^tl, i. eight be suitable to 
their business »odel. In this ^^^^^^ 
Offer partial access to one set of user ^ 

rrterLlrr'to prevent all users from having .ull access 
to all image data. 

offered for sale on the Internet. 
«ews P--^;--;^f^ ;^,3 ,,,ow customers to download a 
The service provider wan ^.^litv for evaluation, 

version of the image with reduced ^^^^^ ,,^iee and 

that want to publish an image, pay 
journals, that wan f quality image, 

are then allowed to download a full qu 

_er, such a service P^vide. „.ts . ^^^^^^ 
and download bit rates. «i imag P cD-^oKs are given 

^t to distribute images on e^^ ^ ^^^^ ^^^^ , 

away or sold for a low ^^^^^'J^ ^^^„i^g tbem at full 

reduced ^ality but they^ t pay^^^^^ 

Tptrin as efficiently as possible. 
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It is also essential tbat customers always can access images 
^i^^ trien^y. stanaaxdise. software. .^,e prov^ers are 

reluctant td design and support special image vxewers and 
customers don't want a proliferation o£ viewing tools. 

presently, iniage providers have to store two visions of the 
images stored. The full quality version « stored a. an 
encrypted image file. This me«is that the image first rs 
:::^essad and stored in a co^ressed file format such as^E3 
HlF. The compressed fUe is then encrypted using a suitable 
elcrj^tion tool ^ an encrypted image file i^/""^; ™! 
mus^irst decrypt this file and th«. access 
compressed image file using an i»age viewing tool Reduced 
qu^ity image, are produced by processing the ^""/^^"^ ^ 
Lges in an image editing program. They are stored as separate 

compressed image files. 

«.e problems with this solution are that at least 

versLs Of the same image need to be "^^^^f,:",, 

aleo be transmitted over the networK m 
versions must also be trans ^^^^ 

« ^he case a customer first wants 
remote access in the case a resolution 
low resolution image before paying for the full 

version. 

-.t.^ in a significant disadvantage if the reduced 
This results in a sign . ^^^^^ion of the image 

version image contains a ™ ^^^^ 

information. Images that are or ^ quality 

- parti.- rdirorw::tTo ^---^^ - 

since journal editors wan ^^^.^^ 
the image content and a«epts o^y 
printing. The reduced quality imag 
storage space of the full -juality image. 

still linage coding standard JTEG 2000, ' 

^trdtscrhenr---^^ 

which IS describea includes many new 

SUBSTTTUTE SHEET (ROLE 26) 
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can select a suitable progression mode. Individual objects 

i-,es can be accessed separately in t.e ...y o 
bitstrean and progressive transmission can be -PP^^"" ° " 
Objects, in JPEG aooo there is also support for independently 
decodable coding units. 

SUMMARY 

It is an object of the present invention to overcome the 
problems as outlined above and in particular to ^^^^^^ 
Lount of memory required for storing an image, whxch partxally 
shall be possible to view, and also to reduce transnuLssxon txme 
in a transmission scheme transmitting partially encrypted 



iioages. 



This Object and others are obtained by a technique for partial 
Taction and progressive trans,«issi=n of i^ges where a f^st 
"c^n Of the image file can be deconpressed at reduced ^ity 
Tthout decryption, i.e. the first lo. quality iaage iS not 
Incrypted, and where a second section of the image file iS 
encrypted . 

V ■„„ access to atmropriate decryption keywords can 
Thus, users "^--a ™ ^» ^ / „ith the 

decrypt this second section^ Th ^ ^^.^^ 

decrypted second section can th^ ^^^^^ 
^ge. The storage ^^^lj;^^^J:i:^°ls !he storage space 

re::::dTorrt:rir.~^^^^ - ^-;r • 

rryPtion Of the se.nd sec- ^ ^ ^ 

encrypt ion method, imply a sxxgn f 

Teclfon co,»pared to the unencrypted second section. 

can also be partitioned into multiple section, where 
The image can also be P individual encryption 

each section may be "'"'"^ """^^ ^ ,^<,^,d unencrypted, 
method and -V«crd. some s™s -^^^^^ 
^ important exemen Of t^^^e^__^^^^ ^^^^^^^ ^ 

herein is that the comp makes xt 

, j-wio (-ofiina units (CO) . iniss 
independently ^-odab^;^^ ,^,,„icn= in the compressed 
possible to perform encrypc f ...-^ 

domain without performing entropy decoding. 
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wo 00/31964 



4 



PCT/SE99/02106 



A reduced quality i-age can be produced according « several 
different main schemes, such as: 

1) Reduced resolution 

2) Reduced accuracy of the transform coefficients^ 

3) Exclusion of predefined regions of ^terest (ROD 

These methods can be co-nbined so that a reduced quality i^age is 
e g produced by reducing both the resolution and the accuracy 
of the transform coefficients. 

By using the method and device for storing and traz^smitting 
Ige d^ta as described herein, several advantages are ohta^ned. 

there is no need to store two different versxons of an 
TZ'. Tf different users are to have access to different qualxty 
xmage xf difte transmission times become much 

of the one and same xmage- Ais . resolution, 
-, -if information content of the fxrst, xow tco 

'Ce - - — "'"^ ' 

jmage data . 

r;r.« — nTilir:: descried i™ ^etan and 
I^th reference to the accompanying drawings, xn «h.=h. 

* f-ile structure of an image. 
. Pig. 1 is a general v.ew of the '^^^ according to 

- Figs. 2a and 2b shows encryption o£ images CM 

"kH - : ri::Th:rt mustrating some steps carried out 
:tr:Ts"lirgrrri;ustrating a client server process. 



pier. *± — J— 

5 is a view of an encryption header 



- Fig. 



DETAILED DESCRIPTION structure of an original, 

Xn Fig. 1, a general vxew of t^e fx ^^^^^ ^^^^ ^^^^ 

^igh resolution, -^^^^^^^^^^^..^..ipendently decodahle coding 
consists of a number of <^-'^^^-^ f^e structure shown in Fig. 
sections lOX. 103 ^'l' ^J^L^ion version of a high 
- the section 10. whx^h ^s a^^^^^ ^^^^^^^^ ^^^^ 

resolution xmage, xs coaeu 

he possible to decode by any receiver. 

SUBSTtlwre SHEET (RULE 2B) 
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The section 103. which comprises data, which combined with the 
The • ^^^^ i„ a ^fliun, resolution versxon of 

data of section 101, resiu.t * „ f-i-rst encryption 

the high resolution image, is encrypted usxng a fxrst encryp 

\ f «nd onlv receivers having access to the correct 
r^;ir.rwiXX .e a^le to decode the data stored in the 
section 103. 

^.nn 105 which comprises data, which combined with the 
Z:TsZ:^^^-- 103 «sul.s in a .UXI .esoXution version 

hig. resdu^lon inage, is en=rvP«d using a secona 
Lrvption method, and only receivers having access to the 
^:;^tion .ey will .e a^le to decode the data stored .n the 
section 105- 

^.s, decoding o. the section - --^-^ ^ ^^Z^^ 
^'Ton^tfl To^L wltTt^f i».ge data «ro„ the section 
rofrtsul in "-diu. resolution i:»ge 1X1. Decryption 113^^d 
101 ^11, combined with the rmage data 

r:^Z VZ:s lo. ^ XO. resmt m . .uu resolution r^ge 



115. 



^.hermore, implementation in - ---^rrinc^Ion 

- °zt: rst:r^- c^dLg u^t o. the 

roMrsram^^a; mserted in the hitstrea» so that a wide 
r^e o£ progressive modes can he supported. 

...1 ^ ti a coding unit is a part of 
T„ JPEG 2OO0 verification model 2.0, a coai 9 
in JPEG <;uuu sDecific bitplane of a given 

the bitstream that encodes a «P<==^' described as any 

^band. in general, a coding ^'^ .'2^^l2n..tio.. The general 
independently decodable -^^l'^^^^^^' ::Z ,s to include so 
^chanism for specifying at is 

called tags that specifies ^ ^,,ji„e order is 

sufficient to =P««'';7„::^rcl riefined in the header that 
::rnLs rrfluirc^g border thus saving the bits that 
needed for inserting explicit tags. 



SUBSnrare SHEET (RULE 2B) 



wo 00/31964 



6 



PCT/SE99/02106 



in Figs 2a and 2b block diagrams describing how encryption can 
be implemented in the JPEG 2000 encoder and decoder 
respectively, are' shown. 

Thus in Fig 2a a block diagram where encryption is performed 
TZr Intropy coding in the encoder is shown. Coding unxts enter 
" entr^y Coding bloc. 20i: Xn the bloc. 201 coding t^e cod^g 
units are entropy coded using some suitable -^-^^J^^^^^^f ^ 
output from the bloc. 201 is fed to a selector whxch selects a 
output entropy coded coding tmit. 

suitable encryption method for each entropy 

some coding units can be selected to not be encrypted at all. 

in response to the selection made in the selector 203 the 
entropy coded coding units are encrypted in a bloc. 205. The 
encrypted coding units together with the not encrypted coding 
^Ifthen form a combined output data stream, which can be 
stored or transmitted. 

coded coding unit, or if tne rece 

encrypted it is directly transmitted t<= a blocK 2S5. 

h„ the selection made in the selector 255 the 
in response to the seiec m a block 253 using a 

entropy coded coding unxts are ^"^^^^ ^^^^ are 

suitable ^^^^^iZ^Z t^^-^^"' 

.hen fed to the block 2S5^ In ^^^^ decryption 

from fed directly from the selector ^ .-opined 

block 253 are entropy '^Tt.. slZ. «hich is fed 

output data stream corresponding to the data 
to the entropy coding block 201 in Fig. 2a. 

Hach coding . -^'^^^^raral^i^n^e^nrntry :";:pt^^tlock . 

ngs. 2a and - "^^^^//.rrcrypted separately with any user 
Each coding unit can also same image 

rbf^eHtnttrL encryption methods, .he 

SUBSTTTUTE SHEET (RULE 26) 
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encryption »echod used can Jurther b. an 

Different encryption methods can in such an enOwdiment have 
!^ «I=al Ilg^thms but different keywords. Encryption Method 
^i:lf ^. as Shown in Figs, .a and 2h is a.y global data 

ra^^t^sL keywords or algorithm identifiers 
to specify the a>cryption Method. Onit Encryption State (DES) is 
a s^l Ihat for each coding .unit defines ho. it is encrypted. 

I, 3 a flow chart illustrating different steps carried oat 

:nc:vpting an i^e are shown. ^^j; "^/e rec::ved 

i^ae to be partially encrypted is received. The image recei 
Tst^ 301 is then coded using a coding algorithm 9e=erat.ng 
t^dl^ndently decodable coding units, e.g. .PEG .000, rn a step 



303. 



hhP codinq units of the image coded 
il sr Citable encryption ^thod, 

T7s Z The cX units that are chosen to b. -crypted 
such as DES^The g ^^^^ preferences. Thu., a user can 

can be set in aocoroan ^„„^„„naing to ROIs, higher order 
chose to have coding units ^ts 
.it-planas etc^ncr^--^-^^V^^^^^, are merged into a 

and the codxng units wnicn d*. 

single bit stream. 

^ transmitting an i™9= a client 

aescribed in ""i-^^^^^j^'^/^ ,he client 401 can then issue 
,0i is ~-fJ-l^ ,03 for a particular 

a request towards the servex 



405. 



server ,03 replies by — -rThrr%rr:;t:d 
i^ge Which are not J,,^,^, „ho now will 

coding units can be decoded by the =li 

access to a low -/^/J^tU/rish to have access t 

- ratrerrsortirrr the^un ^ge. « so the 
the image in a nig"= 

SUBSrmrrE SHEET (RULE 26) 



wo 00/31964 



8 



PCT/SE99/02106 



client transmits a request to the server requesting such 
information, step 409. 

The server replies by sending a request to the client requesting 
the client to agree to the conditions for transmitting the 
higher resolution version of the image, step 411. If the clxent 
agrees via a message 413, e.g. comprising a card number or 
account number from which to bill the cost for the image the 
server sends the encrypted coding units together with a key word 
by means of which the encrypted coding units can be decrypted, 
step 415. A secure method for key distribution should be used. 
Examples of such secure methods are described in W. Stallings 
-Data and computer Communications-, p 635 -637. Prentice-Hall 
1997 fifth edition ISBN 0-13-571274-2. 

If the client already has access to the unencrypted and 
enc^ted coding units, for example if he has purchased a CD-ROM 
"triages coded as described herein. The scheme as described 
in conjunction can be modified so that no image data xs 
Tralsmltted. Instead the client ^^:::rZr'^ 
the server in order to have access to the key word I , 
required to decrypt the encrypted coding unxts of the CD ROM. 

T .h. case when the method and device as described herein is 
in the case when ^^^^^^i^g to the JPEG 2000 standard, xt 

used when encoding image accoraing standardise 

■ f 4-he JPEG 2000 standard does not stanaaraise 
is advantageous If the JPEG ^^^^^^ ^^^^^^^^ 

encryption Encryption Tag that is merged with 

image header or optionally an specify how coding 

the JPEG 2000 Tags can instead be used to specify 

imits are decrypted. 

>^«rf^m«nt the JPEG 2000 image header contains an 
xn such an embedment the J ^^^^^^ 

Encryption ^^^^'J^^ 3hould then be appended to 

encrypted. An ^^^^ encryption information can 

the JPEG 2000 image header and encrypt 

optionally be merged into JPEG 2000 Tags. 

Pig 5 an encryption header is shown. Encryption Header 

canln'such an embodiment contain the following symbols. 

SUBSTTTUTE SHEET (RULE 25) 
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1) Encryption Mode (EM) . A set of standard encryption modes are 
defined e.g. 

a) .one encryption method is used for all coding units 

b) Bitplanes of less significance than bitplane X are encrypted 

c) Subbands of higher resolution than Y are encrypted 

d) ROIs specified in are encrypted, etc. 

NO encryption information need to included in the Tags if an EM 
is defined. 

2) Encryption Mode Parameters (EMP) . Parameters (X, Y. ...) that 
are used to define the Encryption Mode are set here. 

3) Number of encryption methods used. Several encryption methods 
can be used within the same image if e.g. different user groups 
should be allowed to see different image content. 

M«=^^-v,r^/^ n*>scrit)tor (EMD) for each encryption 

4) one Encryption Method Descriptor 

method The EMD defines any data that is needed by the 

each encryption method. This number .s used .n DES symh 

5, The hitstrea. »ust for each coding unit ^P-"^ if it is 

encrypted and if so hy what method. This .s done hy sett-g 
encrypt . ^^.^^ ^^^^ These 

anit ^^'^"""."'"^noL^a in the encryption header or 
symbols could either be collect ^3 encryption 

alternatively be distributed rn header we 

.ags. If the OES information xs ^ept - ^"J^^^ ^„„3,,,3 
define a header element - f/^^ ,,aer as the 

a series of OES symbols that are listed rn the sam 
coding units appears in the bit stream. 

„ is set and the Encryption State is not given in the 

SUBSTTTUTE SHEET (RULE 25) 
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V, .i^r JPEG 2000 Tags can be expanded to contain Onit 
r^;iorstate (DeI) symbols. UBS defines whic^ encryptxon 
Encryption State lUBb y enervating the next coding 

method, if any, that is used for encrypting 

unit • 

described above^ They belonging to the ROI for 

by selecting appropriate coaing 

encryption. 

• 4.>,«^ hhe shaoe of the ROI might reveal the 
Tntr rtrs;;prarren::::ted it is. -e^e.^^^^^^^^^ 
to Show a reduced quality i»age since it is difficult to 
interpret the coded transform coefficients. 

n, can be solved by defining a so called cloaking 
,^3 P-^^-^- 3,,pe of one or several ROIs are 

Shape t--^^^*^ • ^7"^; ,_3j^pe. The c-shape is designed to 
completely enclosed in the c P ^ ^_ 

not reveal sensitive image content. A simp 
shape is a bounding box. 

. -ortT in the JPEG 2000 bit 

. c-shape is renrry^^ion as described in 

stream. The c-shape -^^f /^^^^^ ,,,, Verification Model 

Charilaos ^^^^*^°P°"'°\^"the technique as described therein 
version 2.0. -cording to the te^hn qu ^^^^^^ ^^^^ 

this would result in that the snap 



header. 



c-shape and the transform 
X ..s>c is created = ^J^^ encrvP-d 

coefficients belonging to toe P ^^^^^^ 

,.e .nethoa as described herein ^^^^ ^^.^^^^^ 

all coefficients belonging to of ^^^^ ,^ ^^^^ 

by the c-shape axe encrypted. The tex 
protected by encryption. 

.he Shape of the -^^^^r^^:^ - 
encryption ^'fl'^^^lZ''^,,^ .he corresponding c-shape. 
lin^ encrypte^ .OX shap^= ^^^^^^^^ .be c 

The decoder can now 

SUBSTITUTE SHEET (RULE 26) 
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>. slaved as a blank region. The original ROIs can 

rLrr«.g«i so that the c-shape is dropped and the 
ZX^Zl a!ta struct^es a« «scored. Note that th.a .3 
done in the compressed domain. 

The .asK that is used for encoding a HOI is not ^"^J 

in J^EG 2000. A »aBlc that is sufficiently large so 

is enooded lossless will often cover the whole lower =>^'-^, ^ 

llsfthat is not allowed to will lead to a lossy enooduig 

Tth^^l The »as.s belonging to different KOXs or to a 

aL the bacgroond can be designed to overlap. Th.s „e^s that 

some coefficients are encoded in more than one ^°^-J^^ 

•n T»d to a reduced overall co!il>ression but the ROIS 
overlap wxll lead to a red ^^^^^^^^ ^ 

are more independent so that any kuj. 
with a good visual result. 

for- ROIs described herein is not 

^■^^ r rof^t:rcri:e":r:israsTong as th. ^s. is selected 

dependent of the choi reconstructed from the 

ir: rro^yioi rr bac^gro^d. . --rr^SaL 

.3. that hides^he content e - ^^^^^^ ... 

Christopoulos (ed.), Ji"*^^ 

• .he method and device as described herein storage and 
By using the method an encrypted images is 

^dwidth '^-^^'^-^"^^"^.na fd lompo^ftion and processing of 
reduced, ^rthermore, f^J'^^ ,„,3 be encrypted. 

encrypted "'^^-"^^J^^^ca: be e;crypted and the original 
re;ttanr:e::y;tra:d restored in the co^ressed domain. 

.other advantage is --::rc^Xrt:eTma:r^:s':' since 
performed at the s^e t-e -J ,3t the 

process ta.e place in^^^^^^ ^^^^ 
bitstream syntax) it i P formed just before 

encryption. -;;:::^;:;\Tarser' Uranscoder, . In this case, 
transmitting the image oy 

SUBSTTTUTE SHEET (RULE 26) 
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t.v.0 hitrate which will be the case 
if the encryption increases ^^^^^^l^^' ^ ^^.^ate 

if the encryption is placed xn the tags, the x 
is avoided and the encryption infortnatxon .s only added 
transmitting it- 
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CLAIMS 



1. A B.thod Of partially e„,nnrpting l^ge data comprising t..e 

!lILI^'«>e image data usi^ an anoodin, algorithm generating 
independently deoodatle coding units, 

- encrypting at least one of the coding units, and 

- elding unit, which are not encrypted with cod^ units 
^ich are «>crypted into a combined bitstream. 

^ ^tnod according to Claim 1, characterised in that the not 
^4pted coding units correspond to a low resolution version of 
the image data. 

3 i method according to any of clal« 1 - 2. charaoterised in 

^.r^ codl., units are encrypted using different coding 

methods. 

4 A method according to any of claims 1-3, C^racterized 1. 

4. A metnoa _ indicates if a coding unxt is 
that an encryption flag, wnic« 

encrypted, is inserted in the bit stream. 

5 A method according to any of cl.ims 1 - 4, when information 

5. A metin interest is encrypted, 
irarr.: thrt^e shape of the region of interest is 
enclosed in a cloaXing shape. 

. . «^ial encryption of image data characterized 
6. A device for partial encirifp 

r^ina the image data according to an encoding 
. .eans for decodahle coding units. 

!ra:rco:::^To Ling means for encrypting at least 

one of the coding ^^^^ not encrypted with 

. .eans for merging -^^^^^^^ ""^^l .itstream. 
coding units which are encrypted as 

^ 6 characterized by means for 

, -Vice 'coord^ cla^J^. ..„espond^. 

rorirrroi:::torrsion of the .age data. 
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8 K device according to any of claims 6 7, a 
8. A aevi Aiff^rent coding units using different 

-means for- •encrypting dxcrei^en^ 

coding methods. 

, X device acccrdin, to »y of claims 6 - «, "•"l^!"''!'^''- 
J:Jtor insexti., «. «u:ryption flag, »hlc. u.di=.te. if . 
coding unit is «crypted, in the bit .tr«-. 

,0 » device according to any of clai^ « - 5. 

^renclosing a region of interest shape in a cloa3cing 

shape. 
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